A neural network architecture optimizer based on DARTS and generative adversarial learning

نویسندگان

چکیده

Neural network architecture search automatically configures a set of architectures according to the targeted rules. Thus, it relieves human-dependent effort and repetitive resources consumption for designing neural makes task finding optimum with better performance much more accessible. Network methods based on differentiable (DARTS), however, introduces parameter redundancy. To address this issue, work presents novel method optimizing that combines DARTS generative adversarial learning (GAL). We first find module structures utilizing algorithm. Afterwards, retrieved modules are stacked derive initial architecture. Next, GAL is used prune some branches network, thereby obtaining final The proposed DARTS-GAL re-optimizes searched by simplify connection reduce parameters without compromising performance. Experimental results benchmark datasets, i.e., Mixed National Institute Standards Technology (MNIST), FashionMNIST, Canadian Advanced Research10 (CIFAR10), Research100 (CIAFR100), Cats vs Dogs, voiceprint recognition indicate test accuracies higher than those in majority cases. In particular, solution exhibits an improvement accuracy 7.35% CIFAR10 compared DARTS, attaining state-of-the-art result 99.60%. Additionally, number derived significantly lower method, pruning rate 62.3% at highest case.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Metric Learning-based Generative Adversarial Network

Generative Adversarial Networks (GANs), as a framework for estimating generative models via an adversarial process, have attracted huge attention and have proven to be powerful in a variety of tasks. However, training GANs is well known for being delicate and unstable, partially caused by its sigmoid cross entropy loss function for the discriminator. To overcome such a problem, many researchers...

متن کامل

Adversarial Examples Generation and Defense Based on Generative Adversarial Network

We propose a novel generative adversarial network to generate and defend adversarial examples for deep neural networks (DNN). The adversarial stability of a network D is improved by training alternatively with an additional network G. Our experiment is carried out on MNIST, and the adversarial examples are generated in an efficient way compared with wildly-used gradient based methods. After tra...

متن کامل

Energy-based Generative Adversarial Network

We introduce the “Energy-based Generative Adversarial Network” model (EBGAN) which views the discriminator as an energy function that associates low energies with the regions near the data manifold and higher energies with other regions. Similar to the probabilistic GANs, a generator is trained to produce contrastive samples with minimal energies, while the discriminator is trained to assign hi...

متن کامل

A New Architecture Based on Artificial Neural Network and PSO Algorithm for Estimating Software Development Effort

Software project management has always faced challenges that have often had a great impact on the outcome of projects in future. For this, Managers of software projects always seek solutions against challenges. The implementation of unguaranteed approaches or mere personal experiences by managers does not necessarily suffice for solving the problems. Therefore, the management area of software p...

متن کامل

Wasserstein Generative Adversarial Network

Recent advances in deep generative models give us new perspective on modeling highdimensional, nonlinear data distributions. Especially the GAN training can successfully produce sharp, realistic images. However, GAN sidesteps the use of traditional maximum likelihood learning and instead adopts an two-player game approach. This new training behaves very differently compared to ML learning. Ther...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Information Sciences

سال: 2021

ISSN: ['0020-0255', '1872-6291']

DOI: https://doi.org/10.1016/j.ins.2021.09.041